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Honeybee-inspired dynamics 
for multi-agent decision-making 

Rebecca Gray Alessio Franci Vaibhav Srivastava Naomi Ehrich Leonard 


Abstract 

When choosing between nest sites, a honeybee swarm makes decisions that are sensitive to the values of the 
alternatives. Value-sensitivity is enabled by a distributed social effort among the honeybees, and it leads to decision¬ 
making dynamics of the swarm that are efficient, robust and adaptive. To explore and generalize these features to 
other networks, we design distributed multi-agent system dynamics that recover the high performing value-sensitive 
decision-making of the honeybees. Our framework uses tools of nonlinear dynamics to rigorously connect model- 
based investigation of the mechanisms of animal group decision-making dynamics more generally to systematic, 
bio-inspired design of coordinated control of multi-agent network systems. We augment the model by designing 
feedback dynamics for a bifurcation parameter to control system performance beyond that observed in swarms. 


I. Introduction 

For many applications of multi-agent systems, ranging from transportation networks and mobile sensing networks 
to power networks and synthetic biological networks, successful network-level decision-making among alternatives 
is fundamental to tasks that require coordination among agents. Enabling a group of individual agents to make a 
single choice among alternatives allows the group to collectively decide, for example, which alternative is true, 
which action to take, which direction or motion pattern to follow, or when something in the environment or in the 
state of the system has changed. 

Since animals rely on collective decisions between alternatives for survival, we look to animal groups for 
inspiration. For example, a honeybee swarm makes a single, quick and accurate choice of the best quality nest 
site among scouted-out sites m. A fish school makes a single choice among potential food sources about which 
some individuals may have prior information or preference ||2l. Migratory birds choose together when it is most 
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efficient to depart a rest stop and continue on their route 0. Indeed, from bird flocks to fish schools, animal 
groups are known to manage tasks, such as migration, foraging, and evasion, with speed, accuracy, robustness and 
adaptability ID, even though individuals employ distributed strategies with limitations on sensing, communication, 
and computation a, 0. 

As in the case of animal groups, successful operation of engineered networks in complex environments requires 
robustness to disturbance and adaptation in the face of changes in the environment. Further, like individual animals, 
agents in these kinds of networks typically use distributed control and have limitations on sensing, communication, 
and computation. 

Mechanisms used to study collective animal behavior depend on the animals’ social interactions and on their 
perceptions of their environment. A rigorous understanding of these dependencies makes possible the translation of 
the mechanisms into a systematic, bio-inspired design methodology for use in engineered networks. This remains 
a challenge, however, in part because most studies of collective animal behavior are empirically based or rely on 
mean-field models. 

To address this challenge, we present a generalizable agent-based, dynamic model of distributed decision-making 
between two alternatives. In this type of decision-making, the pitchfork bifurcation is ubiquitous Q; for example, 
it appears in the dynamics of honeybees choosing a nest site and schooling fish selecting a food source. Our 
approach is to derive the agent-based model so that it too exhibits the pitchfork bifurcation. This allows animal 
group dynamics and multi-agent dynamics to be connected mathematically by mapping to the normal form of 
the pitchfork bifurcation. The agent-based model provides an important complement to mean field or simulation 
models by allowing for rigorous analysis of the influence on system performance of distributed information, network 
topology, and other heterogeneities across the network. 

Development of our framework has been largely influenced by the singularity theory approach to bifurcation 
problems lH. The distinction among state, bifurcation, and the so-called unfolding parameters in that theory reflects 
the hierarchy among controlled variables, control variables, and tuning parameters in control theory. This analogy 
naturally translates bifurcation theory into control theory and guides the design of intrinsically nonlinear and tunable 
behaviors. This connection was originally made in a to design neuronal behaviors; see also m for a neuromorphic 
engineering application. In the present paper we prove results in cases with sufficient symmetry such that we do 
not require direct use of the tools of singularity theory. In future work we will exploit singularity theory 0 to 
extend results to the more general cases. 

The generalizability of our framework provides a systematic way to translate a wide range of animal group 
dynamics into distributed multi-agent feedback dynamics; in this paper we focus the networked agent-based model 
dynamics on recovering the high performing, value-sensitive decision-making of a honeybee swarm choosing 
between two candidate nest sites as has been studied empirically and with a mean-field model im, ca ; see 
ini for an agent-based approach. Remarkably, honeybees efficiently and reliably select the highest value nest site, 
and for alternatives of equal value, they quickly make an arbitrary choice but only if the value is sufficiently high. 
Our framework also provides the means to study and design decision-making dynamics beyond that observed in 
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biological networks. To enhance control of network decision-making dynamics, we introduce a feedback law for a 
bifurcation parameter in the model. We prove stability using a time-scale separation of an all-to-all network and 
propose extensions to a general network topology and distributed external information. See related work on control 
of bifurcations lfT4l . ifTSl . ITb). 

The major contributions of our work are threefold. First, we introduce a generalizable agent-based, dynamic 
model for bio-inspired decision-making for a network of distributed agents. We use model reduction and asymptotic 
expansion to show how the model captures the adaptive and robust features of value-sensitive honeybee decision¬ 
making dynamics. Second, we investigate how the value of the alternatives, distribution of information, and 
interaction topology influence the decision-making dynamics in the agent-based model. Third, we show how to 
design slow feedback dynamics for a bifurcation parameter to enhance network decision-making. 

In Section we present the agent-based decision-making model and prove a first theorem on the pitchfork 


bifurcation. Section III describes the honeybee decision-making dynamics, highlighting value-sensitive decision¬ 
making, adaptability and robustness. Model reduction to a low-dimensional, attractive manifold is proved in Section 
[IV] and used to prove an analytical approximation to the pitchfork bifurcation point. The theorems are used in 
Section [V] to show value-sensitivity, performance, and influence of model parameters in the agent-based model. In 
Section |V^ we present feedback dynamics of the bifurcation parameter and we conclude in Section VII 


II. Agent-based decision-making model 

The proposed model is a specialization of the Hopfield network dynamics ( ifTTll . ifTSl l. The model provides a 
generalizable network decision-making dynamic for a set of N interconnected agents and by design it exhibits a 
pitchfork bifurcation. To describe decision-making between two alternatives A and B, let a;^ S K be the state of 
agent i, representing its opinion, with i G TV}. Agent i is said to favor alternative A (B) if Xi > 0 (< 0), 

with the strength of agent i’s opinion given by |a:i|. If Xi = 0, agent i is undecided. The collective opinion of the 
group is defined by y{t) = ^ Let j/ss and Xss be steady state values of y{t) and x{t) = (xi, ..., xnY', 

respectively. 

Let disagreement 6 be defined by 5 = |j/ss| — ;^||®ss||i, where || • ||i is the vector 1-norm. If each entry of x^s has 
the same sign, then there is no disagreement, i.e, i5 = 0. We refer to the scenario with either x^g = 0 (no decision) 
or S ^ 0 (disagreement) as deadlock. A collective decision is made in favor of alternative A (resp. B) if 5 = 0 and 
?/ss > V (resp. t/ss < —I?), for some appropriately chosen threshold rj G K>o- 

The network interconnections define which agents can measure the state of which other agents, and this is encoded 
using a network adjacency matrix A G Each a^- > 0 for i,j G {1, Wj and i ^ j gives the weight that 

agent i puts on its measurement of agent j. Then > 0 implies that j is a neighbor of i. We let an = 0 for all 
i and D G R^^^ be a diagonal matrix with diagonal entries di = L = D — A is the Laplacian matrix 

of the graph associated with the interaction network. 

We define the change in opinion of each agent over time as a function of the agent’s current state, the state of 
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its neighbors and a possible external stimulus Vi'. 

dx^ ^ 

= -Uld^Xi + '^U2aijS{xj) + i^i. ( 1 ) 

G {i^A,0 — G K"'" encodes the external information about an alternative received by agent i, or can 

represent the agent’s preference among alternatives. If i^i = i^a (resp. i/i = —i'b) agent i is informed about, or 
prefers, alternative A (resp. B). If = 0 agent i receives no information or has no preference. ui > 0 and U 2 > 0 
are control parameters and S' : K —> K is a smooth, odd sigmoidal function that satisfies the following conditions: 
S'{z) > 0 Vz G K (monotone); S{z) belongs to sector (0,1]; and sgn(S"(z)) = —sgn(z), where (•)' denotes the 
derivative with respect to the argument of the function, and sgn( ) is the signum function. 

The control ui can be interpreted as the inertia that prevents the agent from rapidly developing a strong opinion. 
The term U 2 S{x) can be interpreted as the opinion of agent j as perceived by agent i. Since S{x) is a saturating 
function, opinions of small magnitude are perceived as they are, while the perception of opinions of large magnitude 
will saturate at some cap. Control U 2 represents the strength of the social effort: a larger U 2 means a larger range 
of unsaturated perceived opinions. 

Let 14 = {vi ,..., VNy, and S{x) = {S{xi ),..., S{xn))'^- Then Q can be written in vector form: 

dx 

— =—uiDx + U 2 AS{x) + V. (2) 

To simplify notation, we study <0 using a timescale change s = uit. We denote x{s) by x and dx/ds by x. Let 
u = U 2 /U 1 , Pi = Vi/ui, Pa = va/ui, Pb = ub/ui and /3 = (/?i,.. .,PnV- Then each Pi G {Pa,0,-Pb} and 0 
is equivalent to 

X =—Dx + uAS{x) + j3. (3) 

To see that these dynamics exhibit a pitchfork bifurcation, let the network graph be fixed, strongly connected, 
and balanced. Then rank(L) = iV — 1 and iJjL = LI at = 0, where 1 w is the vector of N ones. L has a zero 
eigenvalue with corresponding eigenvector a; = Cljv, € K, and every other eigenvalue has positive real part. 
Observe that the linearization of 0 at a; = 0 for u = 1 and /3 = 0 is linear consensus dynamics x = —Lx, which 
converges to the consensus manifold x = (Iai- This implies the possibility of a bifurcation with center manifold 
tangent to the one-dimensional consensus manifold Cl Theorem 3.2.1]. By odd symmetry of 0 for /3 = 0, this 
will generically be a pitchfork H Theorem VL5.1]. 

This is shown in Theorem [T] and illustrated Figure [T] for 0 specialized to an all-to-all network and 13 = 0: 

N 

Xi =-{N - l)x^+'^uS{xj). (4) 

Theorem 1. The following statements hold for the stability of invariant sets of dynamics 0- 

(i) The consensus manifold is globally exponentially stable for each m G IR > 0; 

(ii) at = 0 A globally exponentially stable for u G [0,1) and globally asymptotically stable for u = u* := 1; 
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Fig. 1. For u = 1, dynamics 0 exhibit a pitchfork bifurcation at aj = 0. The steady-state branches emerging at the singularity lie on the 
consensus manifold {xi = Xj\i,j G {1, ...,N}} shown in gray. Branches of stable and unstable solutions are shown as solid and dashed lines, 
respectively. 


(iii) X = 0 is exponentially unstable and there exist two locally exponentially stable equilibrium points :hy{u)lN 
for u > 1, where y{u) > 0 is the positive non-zero solution of —y + uS{y) = 0. In particular, almost all 
trajectories converge to ±y(xi)liv/or u > 1. 

Proof: Beginning with (i); consider a Lyapunov function Vij{x) = ^ ^ follows that 

Vij{x) = -{N - l){xi - Xj){xi - Xj + u{S{xi) - S{xj))) 

< -{N - l){x, - x,f = -2{N - 1)V,„ 

for all Xi ^ Xj. Therefore, for V{x) = ^^=1 Vj{x), V{x) < —2{N — l)V{x), for all a; 7 ^ C G 
V(x) = 0 for Xi = Xj = so by LaSalle’s invariance principle, the consensus manifold is globally exponentially 
stable. 

Using (i), it suffices to study dynamics Q on the consensus manifold, where they reduce to the scalar dynamics 

y = -(N - l)y + u{N - l)S{y). 

(ii) and (iii) follow by inspection of these scalar dynamics and properties of S. ■ 

Remark 1 (Social effort breaks deadlock). Before the pitchfork (u < 1), the deadlock state x = Q is globally 
exponentially stable. After the pitchfork (u > 1), the deadlock state is unstable and two symmetric decision states are 
almost-globally asymptotically stable. Thus, our decision dynamics qualitatively capture a fundamental observation 
of social decision-making that increasing social effort breaks deadlock and leads to a decision through a pitchfork 
bifurcation. 

Remark 2 (Information with symmetry). The pitchfork remains for (3 f 0 when the symmetry of the system is 
preserved, i.e., when (Sa = —/3b and the number of agents informed about A is equal to the number of agents 
informed about B. We prove this for a class of symmetric graphs in Theorem p] 
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Remark 3 (Asymmetry). The symmetry in 01 }nay be lost as a result of unequal values of the alternatives, 
unequal number of agents being exposed to each alternative, or the inherent asymmetry in the graph. The influence 
of asymmetry has been extensively studied in singularity theory using unfolding theory of “perturbed” bifurcations 
(see m)- In particular, singularity theory establishes that as symmetry is lost the pitchfork bifurcation diagram 
generically unfolds into one of the four persistent bifurcation diagrams shown in Figure Because the unfolding 
of the pitchfork is represented by a parametrized path in the unfolding of the cusp catastrophe /O Section III. 12], 
modulation of unfolding parameters (e.g., elements of (3) is associated to a hysteresis phenomenon, which we show 
in Section ^\provides robustness in decision-making. 






Fig. 2. Universal unfolding of the pitchfork: persistent bifurcation diagrams. Blue lines are stable solutions and red lines unstable solutions. 


III. Honeybees and value-sensitive decision-making 

When a honeybee swarm leaves an overpopulated nest, it must find a new high-value nest to survive the next winter 
and do so before the bees next need food. A small percentage of the swarm serve as scouts and these honeybees 
find and examine candidate nest sites, usually cavities in trees. The value of a candidate nest site is determined by 
features such as volume, size of entrance, and height above the ground. Remarkably, a honeybee swarm quickly 
and accurately chooses the highest value nest site among scouted-out sites IT]. Further, when candidate nest sites 
have near-equal value, honeybee swarms can still make highly efficient and robust choices im. Their decisions are 
sensitive both to the difference in value among the candidate nest sites and to the absolute values of the candidate 
nest sites ca. This value-sensitive decision-making means that honeybee swarms can adapt their decisions to 
environmental changes in the value of available nest sites. 

The mechanisms that explain the value-sensitive honeybee decision-making are rigorously studied in ifia using 
the model derived in im. Because the model represents a well-mixed (mean-field) population, it cannot directly 
be used to design distributed control strategies or to examine the influence of network topology or distribution 
of information across the group. However, since the analyses of ifT^ show that the mean-field model exhibits a 
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pitchfork bifurcation, we can design distributed agent-based dynamics that inherit the properties of the honeybee 
dynamics by connecting the mean-field dynamics to our generalizable agent-based model Q. 

Once a honeybee has scouted out a candidate site, she uses explicit signaling in the form of a “waggle dance” 
on the vertical surface of the swarm to advertise and recruit uninformed bees to the site. A collective decision 
by the swarm for one site is made by a quorum. It was shown in im that, in addition to dancing to promote 
their discovered site, the scouts use a cross-inhibitory stop-signal to stop the dancing of the scouts recruiting for a 
competing site. This stop-signaling makes it possible for the swarm to make a quick (and random) decision in the 
case of two near-equal value sites, but to do so only if the nearly equal sites have sufficiently high value. 

A model of the mean-field population-level dynamics of the swarm were derived in im under the assumption 
that the total bee population size N is very large. The model describes the dynamics of yAit) = NA{t)/N and 
yB{t) = NB{t)/N, the fraction of bees in the population committed to nest-site A and B at time t, respectively, 
and yu{t) = Njj/N, the fraction of uncommitted bees in the population. Since N = Na + Nb + Njj is constant, 
Va + Vb + yu = ^ for all time t. Thus, the dynamics evolve on the two-dimensional unit simplex as 

^ = lAyu - yhioiA - PAyu + c^bj/b) 

^ = IbVu - yniaB - PByu + ctaVa)- (5) 

7 i is the rate of scout discovery and commitment, ai the rate of abandonment, pi the rate of recruitment and ai 
the rate of stop-signaling. It is assumed that = Pi = Vi and Ui = ^ where Vi is the assessed value of nest site 
i. Also, ai = a, and so is equal for all sub-populations. A quorum decision is reached when yA or yB crosses 
threshold uj G (0.5,1]. 

For equal-value alternatives (va = vb = i^), there exists a critical rate of stop signaling a* = ^ 7^3372 • If cr < cr* 
the system has one globally stable equilibrium at deadlock: t/a = J/b- For a > a* deadlock is unstable and there are 
two stable equilibria, each corresponding to a decision for one of the two alternatives. This is a pitchfork bifurcation 
with bifurcation parameter a and bifurcation value a = a*. The critical value a* is inversely dependent on the 
value V of the alternatives, which allows the bees to adapt to their environment. Suppose that the bees use a fixed 
rate of stop-signaling a. Then, when choosing between two low-valued alternatives they will remain in deadlock, 
presumably waiting for another nest site candidate to be discovered. But if the two equal alternatives are of high 
value, they will quickly choose one arbitrarily. Per Remark for a given value i/, sufficiently large social effort 
a yields a decision; for the honeybees, the required social effort for a decision increases with decreasing value of 
the alternatives. 

Figure shows the range of values ly and stop-signaling rate a for which one solution (deadlock) and three 
solutions (two stable decisions and one unstable deadlock) exist, as well as the two-dimensional simplexes on 
which the dynamics evolve. The curve between regions describes the inverse relationship between the bifurcation 
point a* and the value z/. 

If asymmetry ba > r'B is introduced in (|^, the pitchfork bifurcation unfolds to yield a persistent bifurcation 
diagram as on the top left of Figure The hysteresis associated with the perturbed pitchfork singularity provides 
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Fig. 3. From (T2). Value-sensitive decision-making for alternatives with equal value u in mean-field model The simplex on the left, 
representative of the grey area, shows convergence to the single stable equilibrium (black circle) at deadlock. The simplex on the right, 
representative of the white area, shows convergence to two stable equilibria at a decision for A or B. The curve that separates the region 
describes the inverse relationship of cr* to v. 


robustness of the group decisions to small fluctuations in the relative value of the alternatives, with a controlling 
what is meant by “small” iTT^ . If Az/ = — v-q < Q and the decision has converged to B, then as Az/ increases, 

the solution does not switch to alternative A immediately as Az.^ becomes positive but persists for small positive 
values of Az/ (and similarly for A and B swapped). 

To explore these dynamics for equal alternatives in the agent-based model (Section |y]l, set ui = 1/v m ^ to 
get 


dx 1 „, , , „ ^ , 

— =- D{x) + U 2 AS{x) + h>. 

at V 


(6) 


IV. Model reduction and bifurcation Analysis 

Returning now to the agent-based model, for certain classes of network graph it is possible to identify a globally 
attractive, low-dimensional manifold on which to reduce the dynamics Q, and to perform analysis on the reduced 
model. The dimensionality N of the system is treated as a discrete parameter, allowing for the study of the sensitivity 
of the dynamics to the sizes of the informed and uninformed populations. 


A. Model reduction to low-dimensional, attractive manifold 

Let ni and n 2 be the number of agents with information jdi = Pp, = Pi and Pi = —/3b = P 2 respectively, and let 
ria = A — rzi — 712 be the number of agents with no information (/3j = 0 = ^3). Let C {1,..., N}, fc £ {1, 2, 3} 
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Fig. 4. Model reduction illustration. By Theorem the graph (left) with N = 12 nodes, ni = n 2 = na = 4 on reduces to a three- 
dimensional system described by the graph (right) on j^. Pink agents have /3i = 1, white agents /3i = 0 and cyan agents /3i = —1. The self 
loops in the reduced model represent the influence of the others in the same group. 


be the index set associated with each group. Also assume 

if i € 1-ki j ^ and i ^ j 

1 

0, otherwise 

for i, j S {1, N}, where a km = 1 if k = m. Under these assumptions, each node in the same group k has the 

same in-degree, dk, and opinion dynamics ([^ for agent i G Ik are 

= -dkXi + w ^ S{x^) + w ^ ^ dkmS{xj) + /3fc. (7) 

ielfc mG{l,2.3}iGl„ 

m^k 

Theorem 1^ allows the analysis of (0 to be restricted to the subspace where each agent in the same group has the 
same opinion. The theorem is illustrated in Figure 

Theorem 2. Every trajectory of the opinion dynamics Q converges exponentially to the three-dimensional manifold 

S = {x G = Xj, \/i,j G Ik,k = 1, 2,3}. 

The dynamics on £ are 

yi = -diyi + u((ni - l)S{yi) + n2di2S{y2) 

. + n^disSiys)) - /3a 

2/2 = -^ 22/2 + u{{n2 - f)S{y2) + nid2iS(yi) ( 8 ) 

+ ri3d235'(2/3)) + /3 b 

2/3 = -42/3 + u{{n3 - f)S{y3) + nid3iS{yi) 

+ n2d32S(y2)). 

Proof: Let V{x) = YX=i Vkix), where Vk{x) = f SjGifc ^ ^ follows that 

Vk{x) XI - Xj) 

iGXfc jeik 

= X X(~ - Xj)'^ - u{xi - Xj){S{xi) - S{xj))) 

leik leXk 
< -dkVkix), 
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so V{x) < —dkV{x). By LaSalle’s invariance principle, every trajectory of Q converges exponentially to the 
largest invariant set in V{x) = 0, which is £. Let yk = Xi, for any i G k G {1, 2, 3}. Then dynamics Q reduce 
to (|8]l. ■ 


B. Pitchfork bifurcations in Z-i symmetric, all-to-all networks 

A vector field F : is Z 2 -symmetric when it commutes with the linear transformation 

Onxn Onx (AT—2n) 

Ofix {N—2n) 

— lN-2n 

for <2n < N. The dynamics © are X 2 -symmetric if = —/3 b = /3, ni = 712 = n, and the graph is symmetric. 


7 = 


•Jnxn 




0{A1—2n)xn ^{N—2n)xn 


The class of graph discussed in Section IV-A is symmetric if Okm = OLmk, for each k,m G {1,2,3}, and 013 = 023 . 


For this class Z 2 symmetry means that reversing the sign of Pa and /3 b is equivalent to applying the transformation 


X I—>■ —X. 

Consider an all-to-all graph with unit weights and Pa = —Pb = P, tii = n 2 = n, which make the dynamics ([^ 
X 2 -symmetric. We can find an approximation u* to the bifurcation point u* by examining the reduced dynamics 
•HI, which specialize to 


yi = -{N - l)yi -f u{{n - l)S{yi) 

+ nS{y2) + nsS^ys)) + P 

y 2 =-{N-l)y 2 + u{nS{yi) (9) 

+ (n- l)S{y 2 ) F nsSiys)) - P 
m = -{N - 1)^3 -f u{nS{yi) 

+ nS(jj2) + (n3 - l)S'(y3)). 


Because of Z 2 symmetry, the deadlock state y*{u,P) = {y* {u, P),—y*{u, P),0) is always an equilibrium, where 
y*{u,P) is the solution to 

{N-l)y*+uS{y*)-P = 0. ( 10 ) 


When /3 = 0, y*{u, 0) = 0 for all u € K. When P f 0, the implicit function theorem ensures that y*{u, /3) depends 
smoothly on u and /3. By Taylor expansion, an approximation to y*{u,P) can be found, and the bifurcation point 
where deadlock becomes unstable can also be approximated. To compare theoretical and numerical results, we let 
S'(-) = tanh(-) in Theorem l^but the computations are general. 


Theorem 3. For dynamics (|^ with S{-) = tanh(-), the following statements hold: 
(i) the equilibrium y*(u,P) = (y*{u, P),—y*{u, P),0) satisfies 

1 „ u 


y*{u,P) = 


N-l + u^^ Z{N-l+uY 


P^ + 0{P^)- 


( 11 ) 
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(ii) the equilibrium y* = (y*,—y*,0) is singular for 

{l + 3N^)^iN-nu) 


u* = 1 + 


9n9 


r+ 0(/?"); 


(iii) for sufficiently small /3, the singular equilibrium at u = u* is a pitchfork bifurcation. 


( 12 ) 


Proof: We begin with (i). Consider Taylor series expansion of y*{u,f3): 

y*{u,j3) = Pyi + 0^y2 + 0^yz + + 0{j3^). (13) 

Substitute y*{u,/3) into and differentiate with respect to /3 to get 

{N - l)y*'{u,/3) +usech^{y*{u,/3))y*'{u,P) -1 = 0. 

Substituting in /? = 0 yields yi = - Proceeding similarly for higher order derivatives gives y 2 = y 4 = 0 and 

u 

^ 3(1V - l + u)4- 

Substituting these values in ( [T3] l yields ( [TT] ), establishing (i). 

At a singular point u*, the Jacobian of Q computed at y* drops rank. The Jacobian of (|^ at y* is 

' —(AT—l)+ii(n—l)S'('y*) unS'{y*) un^ 

unSfy*) —{N—l)-\-u{n — l)S'{y*) un^ , 

unSfy*) unS'{y*) —{N—l)-\-u{n3 — l)_ 

where we have used the fact that S'{-) is an even function. For S'(-) = tanh(-) the determinant d of the Jacobian is 
d = —ip(—1 + N + 2u + ? 7 Cosh( 2 ?/i))(r 7 + 3u + nsu — 2Nu 

— 2v? + (ry + M — n 3 M)cosh( 2 ?/i))sech'^(yi), 

with ry = iV — 1. A positive u = u* for which d = 0 satisfies 

u* = ^(3 + 713 — 2 A^ + cosh( 22 /*) — n 3 Cosh( 2 ?y*) 

+ sj 167 ycosh^(y/*) + (3 + 713 — 2N — (—1 + n 3 )cosh^( 2 jy*])). 

Note that y* is also a function of u* and the above equation is a transcendental equation in u* that can be solved 
numerically. Here, we compute a Taylor series approximation to u*. We know that for /3 = 0, jy* = 0 and u* = 1. As 
above, we begin with the Taylor Series expansion u*{/3) = 1 + m*/3 + + ^ 3 /?^ + 0{j3'^) and match coefficients 

to obtain ( [T^ . 

To prove that the singular point corresponds to a pitchfork we invoke singularity theory for Z 2 -symmetric 
bifurcation problems ||8] Chapter VI]. By Theorem [T] this singular point is a pitchfork for /? = 0. Because is 
Z 2 symmetric, for sufficiently small /3 we obtain a small Z 2 -symmetric perturbation of the pitchfork for (3 = 0. 
Invoking genericity of the pitchfork in Z 2 -symmetric systems Theorem VI.5.1], we conclude that (0 possesses 
a pitchfork at u = u*. ■ 

Remark 4 (Deadlock breaking). Theorem ^ shows persistence of the Theorem ^ bifurcation under Z 2 symmetry 
and weakly informed agents ((3 small). For small social effort (u < u*) deadlock is the only stable equilibrium 
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despite the presence of informed agents, but for sufficiently large social effort (u > u*) deadlock is unstable. In 
the case of 13 0 an unstable deadlock state does not imply that deadlock has been broken, because differences 

in opinions can maintain disagreement for moderate social effort. The feedback control dynamics introduced in 


Section VI overcomes this by increasing the social effort beyond the destabilizing of deadlock. 


Remark 5 (Influence of system parameters). The approximation (ED of u* depends on value (3, total group size 
N and uninformed group size n^; it thus explicitly describes the sensitivity of the bifurcation to group size and 
information strength and distribution. We exploit this in Section |y-Zj| 


V. Value-sensitivity and ineluence of system parameters in agent-based model 

In this section we show how the agent-based dynamics •ID provide a multi-agent network system with the 
value-sensitivity and performance of the honeybees studied with the mean-field model (|^. We use the agent-based 
model to examine the influence of system parameters, including size of the group and strength and distribution of 
information. 


A. Value-sensitivity and performance in agent-based model 

To show value-sensitivity and the associated robustness and adaptability in the agent-based model, we examine 
the dynamics (|^ with bifurcation parameter U 2 = u ■ Ui = 'f. Applying the approximation ( ED for u* gives the 
approximation to the bifurcation point U 2 for (|^ as 




(14) 


- V 9iV9 

Figure shows how well approximates computed using MatCont continuation software 1201. As in the case 
of the honeybee mean-field model (see Figure |D, the bifurcation point in the agent-based model depends inversely 
on the value of the alternatives v (see ( ED and Figure Thus, our agent-based decision-making model recovers 
the value-sensitive decision-making of the honeybee mean-field model. 

This value-sensitivity is demonstrated further in Figure]^ where bifurcation diagrams for the agent-based model 
are given for a range of values v. As v is increased, the bifurcation point decreases and the sharpness of the 
bifurcation branches increases, representing a faster increase in average opinion. 

The value-sensitivity of the agent-based dynamics implies the adaptability of the network to the environment as 
seen in the mean field model; that is, in the case of equal-value alternatives, the multi-agent network will make a 
quick and random decision for one of the two alternatives but only if the value is sufficiently large. Further, because 
the agent-based model maps to the same pitchfork normal form as the mean-field model, the agent-based model 
implies the robustness to small changes in the difference in values of the alternatives discussed for the mean-field 
model in Section|n^ Figure [^illustrates the hysteresis phenomenon that provides this robustness for the agent-based 
dynamics. Suppose va > vb, the network has decided for A, but va decreases. The group will resist changing its 
decision to B unless ua is sufficiently less than vb (unless fSv < —1.2 in Figure 
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Fig. 5. Value-sensitive decision-making for alternatives with equal value v in agent-based model The curve shows how depends 
inversely on u, recovering the value sensitivity of the honeybee mean-field model compare with Figure The blue line shows the 
approximation GD while the red crosses show computed numerically using continuation software. Informed and uninformed group sizes 
are ni = 712 = n = 10 and ns = 80. 



Fig. 6. Bifurcation diagrams for agent-based model with ni = ns = 10, ns = 80 and three values of u. 


B. Influence of system parameters in agent-based model 

An advantage of the agent-based framework is that it makes it possible to systematically study sensitivity of the 
dynamics to model parameters including those that describe network structure and heterogeneity. An examination 
of ( [l4| ) shows that U 2 decreases with increasing total group size N, implying that less social effort is required to 
make a decision with a larger group. In the limit as N increases, U 2 = p- 

Figure shows the inverse relationship between 1 / and U 2 for different values of with hxed N and rii = 
n 2 = N — 2n^. As 713 increases, the number of informed agents decreases, and the curve drops implying that 
increasing the number of uninformed agents reduces the requirement on social effort to destabilize deadlock. This 
result suggests that the agent-based dynamics could be mapped to describe the schooling fish decision dynamics 
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Fig. 7. Hysteresis associated with varying Au = in the agent-based model. This gives rises to robustness with respect variation 

in values. The plot shows stable (blue) and unstable (red) solutions y as a function of Au for U 2 = 1.1, ni = n 2 = 3, ns = 4, and 
(z^A + t^)/2 = 10. 



Fig. 8. The inverse relationship between u and from GD in the agent-based model for three values of ns with N = 7 and m = n 2 = 
N — 2n^. 


discussed in El, where it is shown that increasing the number of uninformed agents allows the group to choose 
the alternative preferred by the majority over a more strongly influencing but minority preference. 

Formal proofs of the influence of parameters in the absence of Z 2 symmetry will be described in future work. 
Here, we numerically investigate for generic balanced connected graphs and asymmetric value of alternatives 
(vA 7 ^ t'e)- When no information is present in the network (/3 = 0), the system is Z 2 -symmetric for a generic 
balanced graph and exhibits a symmetric pitchfork bifurcation. However, in the presence of information (/3 ^ 0) the 
symmetric pitchfork breaks according to the pitchfork unfolding in Figure For small u the group choice for the 
larger value alternative is the sole stable attractor and only for sufficiently large u does the attractor corresponding to 
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Fig. 9. Left: perturbation of pitchfork for balanced graph with heterogeneous information. Right: a qualitatively different perturbation of the 
pitchfork. 



Fig. 10. Left: sharpening of the pitchfork with (3 = 1. Right: subcritical pitchfork in a Z 2 -symmetric graph with /3 = 3. 


the group choice for the smaller value alternative appear in a fold (saddle node) bifurcation (Figure]^ left). Another 
perturbation of the symmetric pitchfork is possible, depending on opinions, in which the attractor corresponding 
to the group with larger value information appears in a fold bifurcation before deadlock is broken (Figure [fright). 
In this case there is bistability between deadlock and the decision for the larger value alternative. For sufficiently 
large u the attractor associated to the choice for the smaller value alternative appears in a second fold bifurcation. 

Figure 10 shows the bifurcation diagrams in the Z 2 -symmetric network shown (also Figure]^. For small /? we 
naturally find the Z 2 -symmetric pitchfork. Increasing the information value leads to a “sharpening” of the pitchfork; 
the parabola of stable decision states becomes wider, which corresponds to faster increase of the average opinion. 


once deadlock is broken (Figure 10 left). Further increasing the information value leads to a subcritical pitchfork, 
in which the two stable decision branches appear before deadlock is broken (Figure right). In this case, the 
network jumps to a large positive or negative average opinion once deadlock is broken, instead of slowly increasing 
or decreasing along one of the two stable branches. Phenomenologically, this is associated to a faster and more 
robust decision-making process. 
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VI. Feedback control oe bifurcation 


Given system parameters, including value of alternatives and number of agents, the bifurcation parameter u in 
Q {U 2 in @) controls if and how a group decision is made. In this section we design slow feedback dynamics 


for u to enhance the decision-making of the multi-agent system. In Section VI-A we prove feedback dynamics for 
u in an all-to-all network that ensures a fast, arbitrary group decision in the case of equal value alternatives. In 


Section VI-B we propose dynamics that apply for a general network graph. 


A. Control of bifurcation with all-to-all network graph 

We consider the following feedback dynamics on the social effort u for the all-to-all system with N uninformed 
agents 


X = —Dx -f uAS{x), 



(15) 


where 0 < e < 1. These dynamics augment the agent-based model 0 such that the social effort slowly increases 
until the magnitude of the average opinion \y\ > yth, where yth > 0 is a desired threshold, e.g., as required for a 
quorum decision. 

By virtue of Theorem [Ji) we can reduce the analysis of ( [TSl l to the consensus manifold x = InV- Then the 
closed-loop dynamics of the average opinion y satisfy 


y = f{y,u) ■■= {N- l){-y + uS{y)), 

u = g{y)-.= f-{yth-y‘^)=-g{y)- ( 16 ) 

Behavior of equation ( [Tbl l can be analyzed using singular perturbation theory ETIl . ESI . We define the slow time 
T = es, which transforms ( [Tbl l into the equivalent dynamics 

ey = (TV - l){-y + uS{y)), 

u' = {yfh - y ^)) ( 17 ) 

where ' = For e <C 1, ( |T6] l describe the boundary layer dynamics, evolving in fast time s: 

y = {N- l){-y + uS{y)), 

u = 0, ( 18 ) 


0 describe the reduced dynamics, evolving in slow time r; 

0 = [N -l){-y + uS{y)), 

u' = {yth - y^) > (19) 

defined on the critical manifold Mq = {{y,u) : —y -f uS{y) = 0}. Equilibria on Mq are also equilibria of the 
boundary layer dynamics. Singular perturbation theory provides a qualitative picture of trajectories of the original 
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Fig. 11. Singular phase portrait (left) and typical trajectory (right) of the closed-loop dynamics {HI 


dynamics: trajectories of the boundary layer dynamics are a good approximation of the original dynamics far from 
Mg, whereas trajectories of the reduced dynamics are a good approximation close to Mg. 

Trajectories of the boundary layer and reduced dynamics are sketched in Figure 11 left. By Theorem Mg is 
composed of a single globally exponentially stable branch y = 0 for u < 1 and three branches emerging from 
a pitchfork bifurcation for u > 1. The outer branches y = ±i/(M) are locally exponentially stable and y = 0 
is unstable. For a given u, trajectories of the boundary layer dynamics (double arrows) converge toward stable 
branches of Mg and are repelled by unstable branches. On Mg, trajectories of the reduced dynamics (single arrow) 
satisfy m' > 0 if \y\ < yth and u' < 0 if \y\ > yth- 

Theorem [^summarizes the qualitative behavior of the closed-loop dynamics for sufficiently small e and u(0) < 1. 
The result is illustrated in Figure right. 


Theorem 4. For all yth > 0 and all 0 < m(0) < 1, there exist e > 0 and 0 < <5 < yth such that, if 0 < e < e and 
|j/(0)| < S the following hold: 

• If y(0) = 0, then y(s) = 0 for all s > 0 and u{s) oo as s ^ oo. 

• If y{0) > 0 (resp. y{0) < 0), there exist 


Ua = m( 0) + e>(e| log(e)l) (20a) 

Ub > Ua, 1 — 5 < Ub < 1 (20b) 

Me = 2 - itb - C>(e| log(e)l) (20c) 


such that m(s) > 0 for all s such that m(0) < m(s) < Uc and 0 < y{s) < e (resp. —e < y(s) < 0) for all s 
such that Ua < u(s) < Uc- Let sg = argming{M(s) = Mc}. There exist 54 = sg + 0(e\ log(e)|) and ci > 0 
such that |y(s) — y(u(s))\ < cic (resp. |y(s) + y(M(s))| < Cie) for all s > S4. Finally y(s) yth (resp. 
y(s) -)■ -yth) and u(s) y~^{yth) as s -t 00 . 
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Proof: The case ?/(0) = 0 is trivial as y = 0 and ii = 

The case y(0) 7 ^ 0 involves singular perturbation methods and is only sketched. Behavior for times such that 
u{0) < u{s) < Ub follows by the standard Tikhonov theorem II 2 TI because the critical manifold is normal hyperbolic 
in that region. The passage through the pitchfork bifurcation for times such that Ub < u{s) < Uc follows by ll^ 
Theorem 2.2.4] because normal hyperbolicity is lost at the pitchfork and the standard Tikhonov theorem does not 
apply. Behavior close to the normally hyperbolic stable branches y = ±y(u) for times s > S 4 follows again by the 
standard Tikhonov theorem. ■ 

Remark 6 (Bifurcation delay). The passage through the pitchfork is characterized by a “bifurcation delay”, that is, 
the system state lies close to the unstable branch of equilibria y{0) for a range of u after the pitchfork bifurcation. 
This delay is illustrated in Figure right. 

Remark 7 (Guaranteed deadlock breaking). For any yth > 0, the proposed feedback control ensures that deadlock 
is broken, at least in the generic case y(0) 7 ^ 0. On the consensus manifold the disagreement 5 is indeed identically 
zero and, under feedback control, the state converges to zbyt/jljv 7 ^ 0 . 

Remark 8 (Informed agents). For [3 f 0, we cannot explicitly reduce the closed-loop dynamics ([T^ to two- 
dimensional dynamics on the consensus manifold. Ai a result, singular perturbation analysis becomes more involved 
and will be left for future work. We can however design feedback dynamics for u in the Z 2 -symmetric case considered 
in Theorem and conjecture the behavior of the closed-loop system. 

By Theorem we can reduce the analysis of the closed-loop system with all-to-all graph under Z 2 symmetry, 
rii = n 2 = n infonned agents and = N — 2n uninformed agents to the four-dimensional singularly perturbed 
dynamics 

yi = -{N - l)yi + u{{n - l)S'(yi) 

+ nS{y2) + nzSiyz)) + /3 

m = -{N - l)y 2 + u{nS{yi) 

+ (n - l) 5 '(y 2 ) + nsSiys)) - /? 

?/3 = -{N - l)y 3 + u{nS{yi) 

+ nS{jj2) + {ns - l)5'(y3)) 

u = e (^Vth - (^;^2n,(yi + ya) + nsys^ ^ , 

which we write in vector form as 

y = f{y,u), u = g{y). ( 21 ) 

By Theorem^ the critical manifold Mq = {{y,u) : f{y,u) = 0} comprises a single Z 2 -symmetric branch 
y{u) = y*{u,/3) for u < u* and three branches y{u) = y*{u,/3), y{u,f3), yy{u,j3) for u > u*, where y*{u,j3) 
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is again a Z 2 -symmetric equilibrium branch and the set {y(M,/3), 7 y(u, ^)} is Z 2 -invariant. 

We note that y = 0 if y = y* (u, /?). As in the /3 = 0 case the central branch of the critical manifold corresponds 
to deadlock. The other branches y{u,/3) and yyiu^jd) may or may not correspond to deadlock, depending on 
the agent spread at those steady states. Because for small /3 these branches are a small perturbation of the 
corresponding branches of the critical manifold in the (3 = 0 case, stability of each branch is preserved. Despite 
the larger dimension, we can conjecture that the weakly informed ((3 small) all-to-all Z 2 -symmetric case described 
by (|21[) is qualitatively equivalent to the (3 = 0 case sketched in Figure 


B. Control of bifurcation for general network graph 

For a general graph we require additional dynamics to allow each agent to estimate the network average opinion 
y, in order to implement feedback dynamics of the form (HD- In HTfi dynamics were presented that allow a group 
of agents to reach dynamic consensus by averaging a time-varying signal. We implement these dynamics to design 
feedback dynamics as 


X = —Dx + diag(M)AS'(a;) 
y = -Ly -f X 

u = e {yk'^N - diag(y)y), (22) 


where jji is agent Fs estimate of the global average, with y{0) = a;(0), L = D — A, and diag(-) is the diagonal 
matrix with elements of the vector argument on the diagonal. For a general graph the agents no longer use the 
same value of the control parameter, i.e., u is an iV-dimensional vector. 

For a fixed, strongly connected, and balanced graph, = 0. This implies the following conservation property: 


d 

ds 


N 


N 




y2 = l 


I > X,, 

\i=i 


Thus, consensus over the estimates (ji will track the time-varying average y = 
We can write the solution y{s) of ([22ll as 


y{s) = e ^®a;(0) + f e ^'’x{s — p)dp. 

Jo 

For a;(0) = 0 and as s —>■ oo we have 

1 ^ r - 

y(s) = —lArl^a;(s) + J e~^^f’mjmjx{s - p) dp 


9=2 • 


where Xj and rrij are the N — 1 non-zero eigenvalues and corresponding eigenvectors of L. Here ^ = yl^ — y is 
the vector of estimate errors, and these errors can be bounded as a function of the eigenstructure of L. For example, 
better connected nodes will have larger eigenvalues and lower bounds on their error. 
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Figure [T^ shows simulation results for the dynamics ( |22] l given the five-agent graph shown at the top and yth = 2. 
The top plot shows the opinion of each agent Xi and the average opinion y as a function of time s. It can be seen 
that the group transitions from deadlock to a collective decision for the alternative B at around s = 10 with y going 
to —yth- Agent 5, the least connected node, is last to join the consensus decision. 

The middle plot shows each estimate jji versus its control parameter Ui as well as average opinion y versus 
F These curves are superimposed on the pitchfork associated with the dynamics with Ui = u for all i. 

The bifurcation delay discussed in Remark]^ is noticeable - the transition to the lower branch solution occurs well 
after the bifurcation point u* = 1 is reached. The bottom plot shows the components of the error vector as a 
function of time s. The errors converge to zero early on, increase during the transition away from deadlock and 
then converge again to zero. During the transition Node 5 experiences the largest increase in error. 

VII. Conclusion 

We have defined an agent-based model that describes distributed dynamics for collective decision-making between 
alternatives in a multi-agent network. The agent-based dynamics are purposefully designed to exhibit a pitchfork 
bifurcation so that the mechanisms of collective animal behavior can be formally translated into bio-inspired control 
design for multi-agent decision-making. Under some symmetry assumptions, we have used this framework to prove 
agent-based dynamics that inherit the value sensitivity and robust and adaptive features of honeybee nest site 
selection. The sensitivity of outcomes to model parameters and heterogeneity have been investigated, and slow 
feedback dynamics have been designed for the bifurcation parameter to enhance control of network decision¬ 
making. The framework will be used for control inspired by high performing decision-making of schooling fish 
and other animal groups. Future work will also make use of singularity theory to address larger classes of network 
graphs and network heterogeneities. 
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